The 50 weight may give you better protection, but 20w is going to give you more startup wear (where most wear happens) than 10w, which is already less than idea.
You want to go the other direction on the first number. 15w50 would be less bad than your 20w50, and 5w40 would probably be a lot better choice.